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PERFORM ANCK  OF  NEURAL  NETWORKS  IN  CLASSIRING  ENVIRONMENTALLY  DISTORTED  TRANSIENT  SIGNALS 


R  L  Field  and  E.  J  Yoerger 

Naval  Oceanographic  and  Atmospheric  Research  Laboratory 
Slcnnis  Space  Center.  MS  39529-5004 
and 

P.  K.  Simpson 

General  Dynamics  Electronics  Division 
P.O.  Box  85310,  San  Diego.  CA  92138 

modulated  signals  with  a  center  frequency  of  50  11/  and  identical 
power  spectra  (Figure  Id).  The  signal  shown  in  Figure  la  (class  1) 
is  a  6?  to  32  Hz  downsweep.  Figure  lb  (class  2)  is  a  32  to  68  Hz 
upsweep  and  Figure  lc  (class  3)  is  the  minimum  phase  version  of 
the  68  to  32  Hz  downsweep 

Environmental  distortion  of  the  above  signals  is  simulated  in  the 
range-dependent  ocean  shown  in  Figure  2  using  a  time domain 
parabolic  equation  (TDPE)  model1.  The  three  signals  are  propagaicd 
out  to  a  range  of  5  km  in  1-km  range  steps  The  signals  arc  received 
at  each  range  on  a  5-clcmcnt  vertical  hydrophone  array  moored  to 
the  ocean  bottom.  The  sensor  separation  is  25  m  The  source  depth 
for  all  three  signals  is  150  m.  This  simulation  corresponds  to  !  c 
location  of  a  transient  experiment  conducted  about  40  rwn  off 
the  California  coast.  Environmental  parameters  typical  of  the 
continental  slope  in  this  area  arc  used  in  the  model 
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„  Abstract 

Neural  networks  have  been  slKiwing  great  promise  in  several  areas', 
one  of  which  is  the  classification  of  underwater  acoustic  transients 
The  classification  of  low-frequency  underwater  acoustic  transient 
signals  using  a  neural  network  based  system  is  investigated  The 
received  acoustic  transients  arc  simulated  using  a  time-domain 
parabolic  equation  model.  The  neural  network  is  trained  on  three 
source  signals  and  tested  by  classifying  the  same  signals  at  25 
different  receiver  locations  in  a  noise-free,  range-dependent  (upslopc) 
environment.  Overall  classification  performance  is  above  90%. 


Syndic  tic  Waveforms  and  Model  Simulations 


The  synthetic  time  waveforms  which  the  network  is  trained  on  are 
shown  in  Figures  la,  b.  and  c.  All  signals  arc  linear  frequency 


TIME  (sec)  FREQUENCY  (Hr) 

Figure  1.  (a)  Class  1:  Linear  FM  downsweep  68-32  Hz,  normalized  time  waveform ;  (b)  Class  2  Linear  FM  upsweep  32-68  Hz, 
normalized  lime  waveform;  (c)  Class  3:  Minimum  phase  linear  FM  downsweep  68-32  Hz,  normalized  time  waveform,  and 
(d)  Normalized  power  spectrum  for  classes  1,  2,  and  3. 
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Figure  2  Distributed  sensor  held  and  range-dependent  ocean  environment 
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figure  3  (a)  TOPE  source  pulse,  and  (b)  power  spectrum  of  TOPE 
source  pulse 

The  broadband  pulse  shown  in  Figure  3a  is  the  TDPE  source 
pulse  The  power  spectrum  of  thus  pulse  is  shown  in  Figure  3b.  The 
received  signals  are  generated  by  convolving  the  propagated 
broadband  pulse  with  the  source  waveforms  shown  in  Figures  la.  b, 
and  c  Figures  4a.  b.  c.  d.  and  e  display  the  pressure  field  of  die 
broadband  pulse  as  a  function  of  depth  and  relative  amval  time  ai 
ranges  1  through  5  km.  respectively  Figures  4a  through  4c  show  the 
bottom  depth  changing  as  the  pulse  marches  upslopc  The  boxes 
drawn  on  the  ocean  bottom  represent  the  army  aperture  at  the 
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respective  range  The  array  samples  the  wavcficld  in  depth  (given  bv 
the  height  of  the  box)  and  in  bmc  (given  by  the  width  of  the  box). 

At  the  I  km  range.  Figure  4a,  there  are  two  fronts,  the  direr, 
arrival.  D.  and  the  surface  reflected  arrival.  S  At  2  km.  Figure  4b. 
these  two  arrivals  begin  to  refract  back  into  the  water  column  due 
to  the  relatively  high  sediment  sound  speed  gradient  These  refractions 
arc  labeled  DR  and  SR  for  dircct-and  surface-reflected  refrac¬ 
tions.  respectively  Distortion  up  to  the  2-km  range  is  due  solely  to 
the  interference  between  the  D  and  S  paths  The  bottom  depth  has 
not  changed  up  to  the  2-km  range  At  3  km.  Figure  4c.  the  smeared 
wavefront  trailing  the  S  wavefront  consists  of  the  first  bottom  bounce, 
B,  the  refracted  fronts  DR  and  SR  that  have  re -entered  the  water 
column  and  the  surface- bottom  reflected  arrival.  SB  These  fronts 
have  become  better  separated  at  4  km.  Figure  4d  Finally,  at  5  km. 
Figure  4c.  the  above  wavefronts  arc  almost  fully  developed  Signal 
distortion  at  each  range  and  depth  is  due  to  the  mutual  interference 
of  these  multipaths  and  the  source  signal  over  the  aperture  of  the 
array. 


Neural  Network  Overview' 


The  most  difficult  neural  networks  to  build  arc  those  that  recognize 
lime-varying  patterns  (spatio-temporal  patterns)  General  Dynamics 
has  been  working  with  neural  networks  for  several  years  that  deal 
explicitly  with  the  recognition  of  time-varying  signals  buried  in  a 
great  deal  of  noise’.  The  neural  network  that  was  used  in  these 
experiments  is  a  product  of  this  work  There  arc  several  aspects  to 
the  work  presented  here  that  are  important  to  point  out:  (1)  the  spatio 
temporal  pattern  recognition  network  is  able  to  Icam  new 
spatio-temporal  patterns  without  destroying  any  of  the  information 
concerning  the  previous  spatio-temporal  patterns;  (2)  the  neural 
networks  are  able  to  respond  very  quickly  both  during  training  and 
during  recall;  and  (3)  the  neural  networks  are  able  to  generalize 
quite  well 

The  neural  network  used  for  these  experiments  is  constructed  in 
four  parts:  (1)  feature  extraction;  (2)  spatial  pattern  classification; 
(3)  spatial  pattern  to  spatio-temporal  pattern  transformation,  and 


(4)  spatio-temporal  pattern  classification  These  four  parts  are  shown 
in  the  block  diagram  in  Figure  5. 

Several  feature  extraction  techniques  were  considered  including 
Fourier  Transforms.  Maximum  Entropy  Method  Coefficients  and 
Gabor  Wavelets  We  settled  on  the  third  transform  as  it  provided  an 
eloquent  way  of  handling  the  low-frequency  data  The  transients  arc 
passed  through  a  Gabor  filter  that  is  6 4  sample  points  in  length  with 
an  8  point  overlap.  Each  set  of  64  points  is  called  a  time  slice  in  this 
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Figure  4.  Pressure  field  tor  broadband  pulse  at  ranges  of  (a) 

context  The  spectral  pattern  created  from  each  64  point  sample  is 
256  bins  that  represent  Ore  frequency  range  from  0  to  100  Hz.  Because 
it  is  possible  to  precompute  the  coefficients  for  the  Gabor  transform 
filter  in  advance  and  place  them  into  a  matrix,  it  is  possible  to  think 
of  the  Gabor  transformation  operation  as  Linear  Associative  Memory 
with  hardwired  weights.  We  use  tnc  Gabor  filter  in  this  contcxl, 
therefore  it  is  considered  to  be  the  first  part  of  this  neural  network. 

The  output  of  the  Gabor  transformation  operation  feeds  dirccdy 
to  a  neural  network  analog  pattern  classifier  that  creates  classes  of 
a  predefined  si/e  from  the  spectral  patterns.  The  neural  network 
performing  the  classification  is  an  on-line  learning  analog  pattern 
classifier  entitled  the  Fuzzy  Adaptive  Resonance  Theory  (Fuzzy  ART) 
neural  network  Fuzzy  ART  successfully  synergizes  the  sophisli- 
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catcd  adaptive  resonance  theory  (ART)  neural  network  with  fuzzy 
theory  to  create  a  flexible,  yet  robust,  pattern  classifier  that  is  able 
to  add  new  pattern  classes  of  a  predefined  size  on-thc-fly4. 

The  output  of  the  Fuzzy  ART  neural  network  is  the  pattern  class 
of  the  spectral  pattern.  By  keeping  track  of  which  classes  that  win 
and  when  they  win,  it  is  possible  to  create  a  spatial  pattern  dial 
represents  the  spatio-temporal  dynamics  of  the  transient  signal  being 
presented.  The  resulting  spatial  pattern  is  then  fed  to  a  second  Fuzzy 
ART  pattern  classifier  that  determines  the  class  for  the  transient. 

Overall,  this  system  has  only  three  parameters  that  must  be  tuned 
and  the  adjustment  for  these  parameters  is  very  straightforward 
Before  discussing  the  results,  two  points  should  be  made  with  regards 
to  the  neural  network  studied  here.  First,  this  system  did  not  work 
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Figure  5.  Block  rliaaram  of  system. 


h  noisy  data  General  Dynamics  has  created  neural  network  noise 
ccllauon  techniques  that  handle  noisy  data  that  arc  not  included 
his  design.  Second,  the  transient  distortion  encountered  here  is 
ited  to  the  ranges,  depths  and  environment  studied.  The  results 
cn  bclotf  would  undoubtedly  change  if  these  studies  were  extended 
Hher  ranges,  depths  and  environments.  The  following  results  are 
liminary 


shows  the  received  wavclorms  lor  class  I  (downsweep)  and  bb 
shows  the  wavclorms  for  class  2  (upsweep)  (The  top  waveforms  of 
Figures  ha.  b,  c.  d.  and  c  are  ihc  source  signals  displayed  for  reference. 
The  vertical  axis  is  sealed  lo  ihc  absolute  maximum  amplitude 
received  over  the  five  sensor  depths  For  example,  in  Figure  ha,  the 
bottom  sensor  at  1460  m  depth  has  ihc  largesi  peak  amplitude  at  this 
range  over  the  5-clcmcm  array  The  source  signal  amplitude  is  one 
There  is  no  significance  lo  location  of  the  signal  in  time  Therefore, 
arrival  limes  cannot  be  inferred  from  the  figures) 

The  next  experiment  dcmonsiratcs  die  ability  of  the  neural  network 
to  nondestructive^  add  new  spano  temporal  patterns  by  adding  a 
third  signal  lo  the  neural  network  This  is  the  minimum  phase  signal, 
class  3.  Figure  lc  Like  the  first  two  source  signals,  this  signal  also 
has  25  received  signals  that  arc  used  to  test  die  network  The  combined 
test  set  consists  of  75-rcccivcd  signals.  25  from  each  of  the  source 
signals  Out  of  75  received  signals,  only  7  arc  classified  incorrectly 
Two  of  the  class  2  signals  arc  classified  incorrccdy  as  class  3  signals 
at  the  3  km  range  for  receiver  depths  of  I4(X)  and  1425  m  Compare 
Figures  6b,  second  test,  and  Figure  he  Five  of  the  class  I  signals  arc 
classified  incorrccdy  as  class  3  signals  at  die  I  km  range  for  all 
receiver  depths.  Compare  Figures  bd  and  he  All  of  the  class  3 
signals  were  correctly  classified  Overall  the  classification  perform¬ 
ance  was  above  90% 


Conclusions 

The  results  presented  here  are  preliminary,  but  encouraging  With 
only  knowledge  of  the  source  signal,  the  neural  network  wa^  able  to 
recognize  the  received  signals  with  90%  accuracy  Although  the 
received  signals  that  were  presented  lo  the  network  were  studied 
under  limited  environmental  conditions  (no  noise  and  short  range) 
they  were  similar  in  their  time-frequency  character.  This  indicates 
that  the  approach  has  the  potential  of  distinguishing  desired  transients 
from  noise  transients.  In  addition,  this  technique  allows  new  signals 
to  be  added  on-lhc-fly,  making  this  approach  lo  transient  signal 
identification  look  extremely  promising. 
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Results  of  Experiments 

fhc  neural  network  is  tested  in  two  wavs.  First,  classes  I  and  2 
used  to  tram  the  network.  Once  these  source  signals  arc  encoded 
'  the  ncrwnrk.  25  different  received  signals  from  each  source 
rial  (for  a  iota!  of  50)  arc  presented  to  the  neural  network.  Each 
civcd  signal  is  classified  into  one  of  two  classes:  class  I. 
•vnsweep  and  class  2,  upsweep.  Of  the  fifty  received  signals,  all 
correctly  classified  except  for  one  (95%  accuracy).  Class  2 
•sweep)  is  incorrectly  classified  as  class  I  (downsweep)  at  a  range 
3  km  and  a  receiver  depth  of  1425  m.  Figures  6a  and  b  show  the 
ie  waveforms  received  across  the  array  at  the  3-km  range.  Figure  6a 
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Figure  6  (a)  Class  1.  downsweep  at  R  =  3  km  upslope;  (b)  Class  2.  upsweep  at  R  =  3  km 
upslope,  (c)  Class  3.  minimum  phase  downsweep  at  R  =  3  km  upslope  (d)  Class  1 
downsweep  at  R  =  1km  upslope  (misclassified  all  Class  1  as  Class  3);  and  (e)  Class  3 
minimum  phase  downsweep  at  R  =  1km  upslope. 
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